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Abstract 

In this note, we point out that infinite-volume Gibbs measures of spin glass 
models on the hypercube can be identified as random probability measures on 
the unit ball of a Hilbert space. This simple observation follows from a result 
of Dovbysh and Sudakov on weakly exchangeable random matrices. Limiting 
Gibbs measures can then be studied as single well-defined objects. This approach 
naturally extends the space of Random Overlap Structures as defined by Aizenman, 
Sims and Starr. We discuss the Ruelle Probability Cascades and the stochastic 
stability within this framework. As an application, we use an idea of Parisi and 
Talagrand to prove that if a sequence of finite-volume Gibbs measures satisfies the 
Ghirlanda-Guerra identities, then the infinite-volume measure must be singular as 
a measure on a Hilbert space. 

1 The Gibbs Measure of Spin Glasses 

A spin glass on N spins is a collection of Gaussian variables or Hamiltonians 

(iI^(a),aG{-l,in 

whose covariance is function of the overlap between configurations. For simplic- 
ity, we restrict ourselves to mean-field systems defined on the hypercube though the 
framework proposed here has a more general scope. For example, the Sherrington- 
Kirkpatrick (SK) model coiTesponds to the case where the Hamiltonians have covari- 
ance K[HN{(T)HN{a')] = N q^^, where the overlap qca' = jj '^i'^i related 
to the Hamming distance on the hypercube by : cTi ^ a'^} = ^(1 — Qaa')- A goal 
is to understand the Gibbs measure /.t^ jv of the model for /? > in the limit N oo 
where 

/^/^.^ ■= [ j2^,,-,H.i.') ^ - e {-!' ■ (1-1) 
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The convergence of the Gibbs measure is usually understood as the convergence of 
the appropriate observables of the model. However, it is not clear a priori that the col- 
lection of limiting observables are functionals of a non-trivial single object amenable 
itself to analysis. This is to be compared with the classical spin systems on the lat- 
tice H^. In this case, the limiting measure is well-defined as a probability measure on 
{ — 1, +1}^ equipped with the cr-algebra generated by functions supported on a finite 
box. And limiting Gibbs measures, that are also translation-invariant, are characterized 
as optimizers of the Gibbs variational principle for the free energy 1 18|. 

It would be desirable to obtain such a transparent framework for mean-field spin 
glasses. A definition for the infinite-volume measure which is well-suited when the 
Hamiltonians exhibit a hierarchical structure is proposed in |8|. In the general case, 
Aizenman, Sims and Starr introduced the notion of Random Overlap Structures or 
ROSt's |3|. A ROSt is a random pair Q) where ^ = (^i, i G N) is a collection of 
summable weights and Q = {qij} is a symmetric positive semi-definite matrix with 
qu = 1. For instance, the Gibbs measure ( II. lb is a ROSt. They prove a variational 
principle for the free energy of the SK model over the space of ROSt's. However, the 
current definition does not specify the topology of the space and therefore the appropri- 
ate definition of convergence of the measure. Moreover, as pointed out by the authors 
in 131, one should not rule out the possibility that the limiting ROSt of a model admits 
continuous weight ^. Thus the space of ROSt's should be enlarged to include such 
cases. 

The purpose of this communication is to observe that, for mean-field spin glasses, 
the collection of observables in the thermodynamic limit defines a random probability 
measure on the unit ball of a separable Hilbert space H. The space A4 of such elements 
is compact and Polish when endowed with the topology coming from the sampling of 
replicas. The space becomes a natural extension of the space of ROSt's, the latter 
corresponding to those measures supported on a countable set of vectors of norm 1. 

The idea is the following. Observables on mean-field spin glasses are obtained by 
sampling configurations with the measure il.li . taking overlaps and averaging over the 
randomness e.g. for some integers ki, fcs(5_i)/2 

where we denote the product measure on s replicas by p'-'^\ the overlap between the 
i-th and the j-th sampled configurations by qij and the average over the randomness of 
the Hamiltonians by /I. Since qa-a ~ 1 and the overlap matrix is positive definite, the 
measure il.li can be thought of as a random probability measure on the unit sphere of 
Ti, by simply embedding the hypercube isometrically in Ti. The overlap between two 
configurations is then the inner product between the vectors and the randomness is the 
one induced by the random Hamiltonian. Since the overlaps take value in [— 1 , 1] , com- 
pactness ensures the existence of a subsequence of /i/j.at for which every observable 
of the above sort converges 1 1 1. It turns out that these limiting observables come also 
from the sampling of a single random measure when measures on the whole unit ball 
are considered - thanks to a result of Dovbysh and Sudakov on exchangeable matrices 
ifTOl (c.f. Theorem l2.2l and Proposition l2.4b . 
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The interest of the above observation is the study of the infinite-volume Gibbs 
measure as a single well-defined object, a random probability measure on H. This 
perspective raises new tantalizing questions besides the well-known conjecture on the 
ultrametricity of the overlaps. For example, do the limiting Gibbs measures admit a 
continuous part ? If they are actually singular, are they pure point ? Are the measures 
supported on a non-random sphere ? Etc. 

The structure of the paper is as follows. The details of the construction of the space 
A4 are presented in Section|2] We also explain how the Gibbs measure at high temper- 
ature and the important examples of the Ruelle Probability Cascades fit naturally in this 
framework c.f. Proposition |2.7| Some properties of the limiting measure are studied in 
Section[3] We start by discussing how the so-called stochastic stability property of the 
Gibbs measure, as studied in ITllQlIIllEI, is expressed by the infinite-volume Gibbs 
measure. In particular, we look at the consequences of the Ghirlanda-Guerra identities 
on the limiting object. Following the idea of Parisi and Talagrand 1151 . we show that 
measures satisfying them must be singular in a suitable sense c.f. Corollarv l3.6l 



2 Gibbs Measure and Weakly Exchangeable Matrix 
2.1 Definitions 

In this section, we first define the space of random overlap matrices that are weakly 
exchangeable. We then present the theorem of Dovbysh and Sudakov that characterizes 
such matrices in terms of random probability measures on a separable Hilbert space. 
The existence of infinite-volume Gibbs measures is a straightforward consequence of 
the latter. 

The set of positive semi-definite symmetric N x N matrices with 1 on the diago- 
nal is plainly a compact Polish space when considered as a closed subset of [—1, 1]^^^ 
equipped with the product topology. We call an element of this space an overlap matrix. 
A random overlap matrix is a Borel probability measure on the space of overlap ma- 
trices. This space is also compact and Polish when equipped with the weak-* topology 
induced by the continuous functions on overlap matrices. Any continuous functional 
in this topology can be approximated by linear combinations of monomials of the form 



E 



n 

l<i<j<s 



(2.1) 



for some random overlap matrix Q — {qij } of law P, s e N and fc^ £ N. 

Definition 2.1. A random overlap matrix Q is said to be weakly exchangeable if for 
any permutation matrix r on finite elements 

We denote the space of weakly exchangeable random overlap matrices by M.. 
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The space is a compact convex subset of the space of random overlap matrices. 
By Choquet's theorem, any element can be written as the barycenter of the extreme 
elements Ext A4. The characterization of the extremes, and hence of the whole set, 
was achieved by Dovbysh and Sudakov ifTOl . 

Theorem 2.2 (Dovbysh-Sudakov). Let Ti. be an infinite-dimensional separable Hilbert 
space. Ext A4 is in bijection with the set of probability measures on the closed unit ball 
ofH, considered up to isometry. 

The correspondence established by Dovbysh and Sudakov works as follows. The 
law of the non-diagonal entries of Q G Ext Ai is the law of the Gram matrix con- 
structed from iid /i-sampled vectors where /i is a probability measure on the unit ball 
of Ti. Precisely, for i ^ j 



where {vi,i G N) is a sequence of iid /i-distributed vectors. We stress that, even though 
(wi, Vi)i-L can be strictly smaller than 1, qu — 1 for all i. It is clear that two measures fi 
and ji' which differ by an isometry of Ti, ji' — ji o U^^ for some isometry U, yield the 
same law. Conversely, if no such isometry exists, they produce two different elements 
of A^. A simple element of Ext is the identity matrix Q = Id a.s. In this case, the 
corresponding ji is the delta measure on the vector 

From this perspective, since is the closed convex hull of Ext M., the whole set 
is in correspondence with the convex combinations of probability measures, or random 
probability measures, on the unit ball of Ti. We call the random measure associated 
with the weakly exchangeable matrix Q the directing measure ofQ. Similarly as above, 
we write /x*-''-' for the product measure of s copies of /i, /x*^*^ := /i x ... x fi, and /i^**) 
when it is averaged over the randomness of ^. 

From now on, we identify Ai with the set of random probability measure on the 
unit ball of 7i, considered up to isometry. The topology on A4 naturally translates into 
the topology given by sampled replicas or copies of the directing measure. Namely, if 
Q is weakly exchangeable with directing measure /i, (12. It becomes 



The above considerations translate into a simple lemma. 

Lemma 2.3. The space Ai of random probability measure on Ti. considered up to 
isometry is a compact Polish space when equipped with the topology generated by the 
linear span of functions of the form ( I2.2l l. 

We note that the space of ROSt's as described in |[3| is a subset of AA corresponding 
to the directing measures that are supported on a countable number of vectors sitting on 
the unit sphere. We stress that, under the topology considered here, the norm of the vec- 
tors on which the directing /i is supported is not preserved under the convergence in M . 
For example, the uniform measure on N orthonormal vectors e^, ^xn = X^iLi '^e^, 
converges in to the delta measure at 0. 




(2.2) 
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Theorem l2 . 2l ensures the existence of infinite-volume Gibbs measures of mean-field 
spin glasses as the limit in A4 of finite Gibbs measures. 

Proposition 2.4. Let np^N be a Gibbs measure of the form ( II. 11 1. There exists a subse- 
quence converging to some fip in Ai. In particular, fip can be identified, up to isometry, 
to a random probability measure on the unit ball ofTi. 

Proof. As noted earlier, the measure iip^N of dl.ll ) can be seen as a random probabil- 
ity on H. by embedding the hypercube isometrically in 7Y. The sequence of weakly 
exchangeable matrices built by sampling replicas with this measure has a converging 
subsequence by the compactness of M. Moreover, the hmiting random matrix must 
have a directing measure pf3 by Theorem l2.2l □ 

Before investigating the properties of infinite-volume Gibbs measures as probabil- 
ity measures on TL, we turn to some relevant examples. 



2.2 Examples 

2.2.1 The Gibbs measure of the SK model at high temperature 

Let jJLp^N be the Gibbs measure of the SK model for some temperature (3 and for zero 
magnetic field. It was proven in |2| that for /? < 1 

lim pfj,{q,2=0) = l. (2.3) 

It follows that 

Proposition 2.5. The limit p,p of any converging subsequence of {pp^^} in M is the 
delta measure on the zero vector pp — 6o a.s. 

Proof. By ( 12.31 ) any limit of functionals of the form ( I2.2l i is 0. Therefore, these func- 
tionals evaluated at any limit point up of the sequence must be also 0. Hence the 
overlap matrix constructed from a sampling of pp is the identity almost surely and the 
claim follows. □ 

A similar result holds for the replica symmetric region with non-zero magnetic 
field. In that case, the limiting measure is supported on a single vector of norm 
< q < 1, where q is the solution to the self-consistency equation. 



2.2.2 The Ruelle Probability Cascades 

We detail how the Ruelle Probability Cascades as constructed by Ruelle lfT6ll and re- 
considered by Bolthausen and Sznitman |7 1 conveniently fit in A^. 

We recall that a Bolthausen-Sznitman coalescent F = (r(t) , t > 0) is a continuous- 
time Markov process on the space of partitions of N. A partition of N is a collection 
of disjoint blocks of integers whose union is N. At time t = 0, we set r(0) = N = 
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{{1}, {2}, ...}. The partition at time t + t' conditionally on the partition at time t is 
obtained by lumping blocks of r(/;) (see Proposition 1 . 1 of |7 1 for the precise transition 
probabilities). The lumping is such that r(t) is an exchangeable partition for every t 
i.e. the probability of i belonging to a given block is independent of i. One defines the 
stopping time Tij as the infimum over the time t such that i and j belong to the same 
block r{t). Since the partitions are nested by definition, the r's satisfy the ultrametric 
inequality < max{Tik,Tjk} for any i, j, fc G N c.f. Equation 0.1 1 in |7|. Moreover, 
by the exchangeability of the partitions, the joint distribution of the r's is also invariant 
under a permutation of the indices. 

From the Bolthausen and Sznitman perspective, a Ruelle Probability Cascade (RPC) 
is a time change of the coalescent. Namely, let F be the Bolthausen-Sznitman coales- 
cent and x : [0, 1] — > [0, 1] a cumulative distribution function on [0, 1], one considers 
the random matrix Q = {qij} 

q^, -.^ x-\e-^^') (2.4) 

for the right-continuous inverse x^^(e^*) 'nal{q > : x{q) > e^*}. We claim that 
(12.41 ) defines an element of M. Since F(0) = N, qu = 1 for all i. The matrix Q = 
{qij} is clearly symmetric. It is also positive semi-definite: since Ty < maxjrifc, Tjk}, 
then qij > mm{qih,qjk} and Q is the covariance matrix of the Gaussian field on 
the tree defined by the ultrametric r. Finally, Q is weakly exchangeable from the 
exchangeability property it inherits from the r's. 

Definition 2.6. A Ruelle Probability Cascade (RPC) fXx with parameter x : [0, 1] 
[0, 1] is the element of constructed from the Bolthausen-Sznitmancoalescent through 
(IZ4l) . 

In the case where the function a; is a step function, the definition coincides with the 
construction of Ruelle as stated in Theorem 2.2 of |7 1. In fact, the directing measure 
is exactly the cascade of orthonormal vectors with weight given by Poisson-Dirichlet 
processes constructed by Ruelle. The advantage of the above definition is the fact that 
the continuous cases as well as the degenerate cases have a well-defined meaning. For 
example, the case x{q) = 1 corresponds to the matrix qij — 1 for i^j G N with 
directing measure — Se for some vector e of norm 1 and x{q) = for q G [0, 1) 
yields Q = ld with directing measure fi^ = Sq. 

A good topology for RPC's turns out to be the L^{[0, l])-norm on the space of the 
parameters x. Indeed, the Parisi functionals seen as functionals on RPC's are contin- 
uous in this topology lfT2l l5l. It is interesting to note that this topology corresponds 
exactly to the topology the RPC's inherit as a subset of A4. 

Proposition 2.7. The M topology on the set of RPC's is equivalent to the i^([0, 1]) 
topology on the parameters x : [0, 1] ~^ [0, 1]. 

In other words, ^Lx^ converges to fi in M if and only if ^ is a RPC with parameter 
X and Xn converges to x in ([0, 1]). In particular, the RPC's form a compact subset 
ofM. 

Proof. For right-continuous increasing functions on a compact interval, the con- 
vergence is equivalent to the pointwise convergence of the right-continuous inverse. 
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Therefore if x„ ^ x in it follows from ( I2.4l l that fix„ converges to in A4 and the 
<^ part of the claim is proven. Now suppose that /i^;^ converges to /i in A^. Denote the 
respective random overlap matrices by Qn and Q. By the Skorohod's representation 
theorem (see e.g. Corollary 6.12 in ||T4| ). there exists a probability space such that 
Qn — Q almost surely. By ( 12.41 ). it follows that for every pair i.j, x~^{e~'^'^) con- 
verges to some number yij. On the other hand, the collection of stopping time {ry }i<j 
is dense in (0, oo) F-a.s. This is a basic consequence of the form of the generator of F 
c.f. Proposition 1.3 in fT^. We conclude that the collection of limits j/^ defines a right- 
continuous increasing function that we call y. By construction ^ y pointwise so 
that Xn y^^ in L^. The =^ part follows by taking x := y^^. 

□ 

3 Properties of the limiting Gibbs Measure 

It would be desirable to characterize the Gibbs measure of spin glasses simply in terms 
of its infinite-volume properties. The Parisi theory for the SK model predicts that 
the infinite-volume Gibbs measure ought to be a Ruelle Probability Cascade, as far 
as observables of the form ( 12.2b are concerned. An appealing strategy to single out 
the RPC's is to characterize elements in A4 that are stochastically stable, a property 
exhibited by a large class of spin glasses including the SK model |[Tl|9l[T3l. In the 
first part of this section, we discuss how the stochastic stability of the Gibbs measure 
of a spin glass is expressed by the infinite-volume measure. Such measures turn out to 
be natural stochastically-invariant measure on H and are believed to characterize the 
RPC's, see e.g. [4|. Second, in the spirit of Parisi and Talagrand flSl, we show that the 
directing measure, as a measure on H, must be singular whenever they are satisfied. 

3.1 Stochastic Stability and the Ghirlanda-Guerra Identities 

We define the stochastic stability property as in 1110. Consider a measure iip.N of 
the form (II. lb . We denote by np.x^N the perturbed measure where Hn{(t) is re- 
placed by the Hamiltonian Hn{(t) := HN{a) + XK{a) where K is a Gaussian 
field on { — 1,+1}^ independent of Hn with covariance matrix M[K{a)K{a')] = 
^E[HN{<y)HN{a')]. 

Definition 3.1. The sequence of measure {^jl^.n} is said to be stochastically stable at 
P > and A > if for any bounded continuous function Fs{{qij}) on s replicas 



N—*oo ^' ■ N^Qo ' ■ 

It was proven by Contucci and Giardina that a large class of spin glasses, includ- 
ing the SK model, are stochastically stable for almost all /3 jo). We remark that the 
stochastic stability translates into a natural invariance property of the limiting Gibbs 
measure. 

Let K = II'^IIw < 1) be a Gaussian field labeled by the unit ball of 7i with 

covariance given by a function of the inner product on 7i - in such a way that the 
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quadratic form is positive definite. We define the mapping 

^AiX ^ M (3.1) 

where the randomness of the image $aM is induced by the randomness of fi and the 
one of K. It can be checked that the function v i-^ k{v) is measurable K-a.s. Moreover, 
the normalization is finite a.s. since by Fubini 



M(dw') e^"^"'' <e^'/^ (3.3) 

Finally, since the law of k is invariant under isometry, the image is an element of A4. 
The above remarks ensures that the mapping $a is well-defined. 

Again since observables of the form (I2.2l i determine the directing measure in M 
and since this space is compact, the following directly holds. 

Proposition 3.2. Let {fJ-fj.N} be stochastically stable. There exists a subsequence such 
that {$AA*,3.JVfc} o.nd {A*0,iVfc} converge respectively to flp, fxp and for which 

. V 

fJ'f3 = fJ-p ■ 

It would be interesting to show whether or not the mapping $a is continuous in the 
Ai topology. If so, limit points of stochastically stable measures would be fixed points 

of $A. 

This mapping is a natural transformation of a probability measure on H where the 
weight associated with each vector is scaled by a function of the Gaussian variable of 
this point, when 7i is seen as a Gaussian Hilbert space. It is the continuous generahza- 
tion of the correlated evolution for competing particle systems or ROSt's as considered 
in lfT7l l4l when the directing measure is discrete. In that case, the weight of a vector is 
the position of a particle and the isometry is replaced by the ordering of the positions. 
The mapping $a corresponds to the incrementation of the positions of the particles cor- 
related through the overlap matrix. It seems to be a fundamental issue to characterize 
invariant measure under ( 13.3b . In the discrete setting, it was shown under some ro- 
bustness conditions that the Ruelle Probability Cascades are the only ones |4|, thereby 
singling out the ultrametric structure of the directing measure. 

Deep results can already be derived from the stochastic stability property. One 
of the most studied is the fact that stochastic stability implies non-trivial relations 
between observables known as the Ghirlanda-Guerra identities and the Aizenman- 
Contucci polynomials ITTl [T] |9] IS). In this paper, we focus on the strongest form of 
these identities. 

Definition 3.3. A sequence of random probability measures {(J-n} is said to satisfy the 
Ghirlanda-Guerra identities if 



-jiN X {qtj}t,j<s) + -^IJ-N iPi^i3'A<lij}iJ<s) + o(l) (3.4) 

* J=2 
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for all s S N and all bounded continuous functions F that depend on the overlaps 
of s sampled vectors {<7ij}ij<s and of the overlap of an s + \-th vector with the first 
sampled one qi,s+i- 

Ghirlanda and Guerra proved that the identities hold for the Gibbs measure of the 
SK model at almost all /3 > 0. Since the functionals appearing in the identities are 
continuous functions in A1, it follows that the identities are fulfilled by any limiting 
Gibbs measure. 

Proposition 3.4. If C M satisfies ( 13 .41 1. then any of its limit points n must obey 

I I « 

--fx X pi^){F{ql^,+l■{<1^3}^<3) + l^-^'^F [q^ s] {qtj} iKj) (3.5) 

for all s £ N and all bounded continuous function F as above. 

The interest of the last observation is that one can now study the Ghirlanda-Guerra 
identities as an identity on the sampling probability measure on TC as opposed to rela- 
tions on infinite overlap matrices. 

3.2 Singularity of the Gibbs Measure 

What does it mean for a probability measure on Ti to satisfy the Ghirlanda-Guerra 
identities ? Parisi and Talagrand proved that the distribution on [—1, 1] induced by the 
overlap of two sampled vectors must be discrete [ I5J. We apply the same idea to inves- 
tigate the singularity of the full measure in A4. We remark that the Ruelle Probability 
Cascades are known to satisfy the Ghirlanda-Guerra identities f8' '6l. The directing 
measure of a RPC being pure point, one could conjecture that this is always the case 
whenever the identities are fulfilled. We prove a weaker version of this assertion. 

Lemma 3.5. Consider the event As ■= {qis 7^ ^ii V 2 < i < s — 1} that the 
inner product of the s-th sampled vector with the first sampled one differs from all the 
previous ones. If fi satisfies the identities ( 13. 5t , then for any realization of fi a.s. 

liminf = . 



Proof. Following ifTsl . for (5 > we define the function 

Fs{qis; {qii}i<s^i) = 1 - min{l, \\qis - qu\ i = 2, s - 1} . 



This a bounded continuous function of the entries. Moreover, it is easily checked that 
as S Fs converges pointwise to the indicator function of — {3 2 < i < 

s-1 : qis ^ qu}. Plainly, XA-{qii, {qu}i<s-i) = 1- 
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Plugging Fs into (13.51 1 and using dominated convergence as 5 ^ 0, we get 



1 



s - 2 



s - 1 



s - 1 



Hence linis^oo /^'"H-^s) = ^-S- Moreover by Fatou's Lemma 



= lim > liminf > 



and the desired conclusion holds. 



□ 



Corollary 3.6. If ^ G A4 satisfies the Ghirlanda-Guerra identities ( 13. St , then it must 
be singular in the following sense: Let B CZ M.'^ be a closed ball in for any d G N. 
If n{B) > 0, the conditional probability /i( \B) is singular a.s. with respect to the 
Lebesgue measure on B. 

Proof. Let Bs ~ {vi E B \fi — 1, s} be the event that s vectors are sampled in B. 
Note that p'-'^\Bs) > whenever ii{B) > so the conditional measure \Bs) is 
well-defined. It immediately follows from Lemma [331 that a.s. 



Now suppose that with positive probability p{ \B) is absolutely continuous with re- 
spect to the Lebesgue measure on B. Then so is \Bs) for the Lebesgue mea- 
sure j/j^' on S*. In particular the event = {3 2 < i < s — 1 : qis = qu} 
has probabiHty p^^^iA^ \Bs) = for all s since J^B^(yl^) = 0. We conclude that 
lim^^oo M*"*"* i-^s \Bs) = 1 with positive probability thereby contradicting ( 13.61 ). □ 
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